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Specification 




Title of Invention 
Convolution Processor Circuit 



2. Claim 

A convolution processor circuit that performs a filtering based on a convolution 
calculation using a correction function according to the dimension of a transmission 
function at a signal transmission system, characterized in that the correction function 
according to the dimension of the transmission function is developed in a small range of 
dimension in advance; separately determined filters are serially arranged at multiple 
stages. 

Detailed Description of the Invention (f^ 
This invention pertains to a convolution processor circuit that performs a filtering ^£ 

of an image signal to improve the recovery of the original image. 

For example, when an image signal read by scanning and sampling the original 

image on the input side at a pixel unit as in an image input/output device such as a ^ 

facsimile is transmitted to the output side, the image signal is made smooth due to an 



effect of the transmission function of the transmission system. Because of this, a 
reception signal needs to be corrected on the output side to recover to the original image 
signal by applying a convolution. 

More specifically, as shown in Fig.l (a), an input signal f(t) is smoothed to a 
signal as indicated by g(t) on the output end due to an effect of a transmission function 
h(u) of the transmission system. The relation between these functions is indicated by the 
following formula: 

g(t)» |h(uj-'f (t-u) do ...(i) 

In order to recover the smoothed signal g(t) to the original signal, an arithmetic 
process as indicated in the following formula is executed using a correction function c(u): 
(** 

f(t>- | c(u). % (t-u) do .-.{2} 

In this case, represents a recovery signal. 

If the signals f(t) and g(t) are quantified digital signals, the relation between the 
formulas (1) and (2) is given by the following formulas: 

i s c (k. 4) *g -W 

The arithmetic process based on the formulas (1) to (4), more specifically, a 
multiplication operation of the signals on a time axis is called a convolution by filtering. 
A convolution signal is usually indicated by "*." 

When the convolution process is carried out, as the dimension of the transmission 
function h(u) becomes larger as shown in Fig.l (b), the range of the correction function 



c(u) is expanded more. Thereby, correction ranges M' and N' of the smoothed signal g (i, 
j) become larger at the application of the formula (4). 

Fig.2 (a) and (b) indicate an example of the transmission function h corresponding 
to the formula (3) and an example of the correction function c corresponding to the 
formula (4), respectively. 

A circuit structure as shown in Fig.3 is conventionally used so as to execute this 
type of convolution in detail. 

More specifically, by shifting digital image signals DBS each by a single pixel 
portion, which are successively coming from the outside at a pixel unit, at a shift register 
unit comprising shift registers SR U to SR^ by a portion of a single pixel with a M x M 
structure and line shift registers LSR, to LSR M _, for a single line delay, image information 
within a specific pixel region is extracted in a part comprising the shift registers SR U to 
SR^. An arithmetic process according to the formula (4) is executed at a computer OPC 
(in this case, it is set at M'=M and N'=M) based on each content (refer to Fig.2 b) of data 
g (i+k, j+1) relating to the concentration level of each extracted pixel and a correction 
function c (k, 1) stored in a memory ROM in advance. 

In detail, at the computer OPC, the product of the data content of the shift register 
SR n and a correction value at c (1, 1), the product of the data content of a shift register 
SRI 2 and a correction value at c (1, 2), and similarly all the products of the data contents 
of respective shift registers SR and values of correction functions c (k, 1) presented at 
address corresponding to the data contents are obtained. Adding these results, a 

processing signal (i,j) is output. 



However, at the convolution process using these circuit components, when the 
dimension M x M of the transmission function h (K, 1) is large, the arithmetic size at the 
computer OPC increases according to the dimension to complicate the circuit 
components, increase the processing period, and to increase the capacity of the memory 
ROM. 

The present invention is produced in consideration of these disadvantages and to 
offer a convolution processor circuit that is capable of setting the application range as 
needed by properly combining multiple units according to the dimension of the 
transmission function and of realizing a high speed processing by simplifying the entire 
circuit components. 

A working example of the invention is described hereinbelow with reference to 
the attached drawings. 

If the formula (4) is represented by convolution symbols, the following formula is 

given: 

The correction function c becomes the following formula: 

i i 

Therefore, when the formula (5) is substituted for the formula (6), the signal 
can be rewritten so as to be the following formula: 

=(<••* «*ici > *c,) * *• ) *e. •»(« 



In other words, the function c of the formula (5) having a larger dimension can be 
represented by a function c„ c^ c 3 ...or c n having a smaller dimension as shown in the 
formula (7). 

Focusing on this point, the convolution processor circuit of the invention executes 
the arithmetic process based on the formula (7) by serially arranging smaller filters 
having correction functions c x (x=l, 2, 3, n) with a smaller dimension at n stages, 
which are obtained by dividing a single convolution filter with a large correction function 
c dimension into n pieces. 

Fig.4 illustrates an example of the components of the convolution processor 
circuit by the invention. In this case, a single processor P (a small filter) is constituted 
such that the correction range of the smoothed signal g(i, j) becomes a pixel region with a 
3x3 structure. Multiple processors P, to P n are serially connected at multiple stages. 

More specifically, each processor P is comprised of the following components: a 
shift register unit consisting of shift registers SR n to SR 33 each by a single pixel portion, 
which extract digital image information in a specific pixel region with a 3 x 3 structure 
and line shift registers LSR, and LSR 2 ; a memory ROM wherein a correction function c 
(k, 1) according to the correction range with the 3 x 3 structure is stored in advance; and a 
computer OPC that performs a calculation obtain the sum of products for the 
aforementioned convolution according to the data g (i+k, j+1) pertaining to the 
concentration level of each extracted pixel. When such a standardized processor with the 
same constitution is serially provided at multiple numbers, a wide range of application is 
possible. 



At the time, the content of each memory ROM, to ROM n within each processor 
PI to Pn, more specifically, the value of each correction function c, to c n at the formula 
(7) is determined as described below according to the number n of the processors P to be 
used. 

If c, to c n are defined as correction filters with the 3 x 3 structure, 
cjtfcifcc,;* * c a -i b ecome a filter having a size of (2n-l) x (2n-l). If the element of 

tap-i) (») 

this filter is indicated by * and if the element of c n by , the following 

formula is established: 

»> - * i •<•> t ..*-«> ... (8 , 

Relations 1 * 1 * 2n + 1 'and l ^^ 2n + 1 are obtained. If m and n of % * 1 

take values except for 1 to 2n-l, ™ " * is defined. 

Accordingly, by lowering a dimension 2n+l of the filter to a dimension 2n-l and 
further continuously apply a similar procedure using the formula (8), a numerical value of 
each filter of c, to c n at the formula (7) is obtained. 

Fig. 5 illustrates numerical values of filters when the correction function c of Fig.2 
(b) is developed into correction functions c, and c 2 with two dimensions. 

When the data signal smoothed with the transmission function at the signal 
transmission system is recovered at the convolution process, the convolution processor 
circuit of the invention the small filters having the small range of correction functions in 
advance are serially arranged at multiple stages as needed according to the dimension of 




the transmission function, in lieu of the single convolution filter having the correction 
function according to the transmission function, thereby giving the same function. These 
small filters are standardized to simplify the entire circuit structure, thereby simplifying 
the arithmetic content at each small filter to achieve a high speed processing. 

Brief Description of the Drawings 

Fig.l (a) and (b) individually illustrate a convolution process according to the 
dimension of a transmission function at a signal transmission system in the form of a 
wave. Fig.2 (a) illustrates an example of the transmission function, and Fig.2 (b) an 
example of a correction function. Fig. 3 is a block diagram illustrating prior art 
convolution processor circuit. Fig.5 is a block diagram illustrating a convolution 
processor circuit as in a working example of the invention. Fig.5 illustrates each 
correction function when the correction function of Fig.2 (b) is developed into two 
dimensions. 

SR... Shift register 
LSR. . .Line shift register 
OPC... Computer 
P. . .Processor (small filter) 
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Abstract Of JP57024168 

PURPOSEtTo make the applied range free, by 
making a convolution processing circuit unft 
and suitably combining a plurality of units 
according to the spread of transfer functions. 
CONSTITUTIONS plurality of processors P1- 
pn are "m series connection with multistage. 
Each processor consists of a shift register 
section which consists of shift registers SR1 1- 
SR33 and line shift registers LSR1, LSR2 for 
one video element's share picking up a digital 
video information in, e.g.. 3X3 constitution 
specific video element area, memory ROM 
stored with correcton function according to the 
correcting mage of 3X3 constitution, and 
operation device OPC performing the product 
sum operation for the convolution according to 
the data relating to the density level of each 
video element picked up at the shift registers 
SR11-SR13 and to the memory content The 
application with a broad range can be made by 
providing the processors In series by the 
number required for the spread of a transfer 
function. 



DBS 




Data supplied from the esp@cenef database » Worldwide 



http://v3.espacenet.com/textdoc?DB=EPODOC&JDX=JP57024168&F=8 



08/25/04 15:35 FAX 216 621 6165 RENNER OTTO 20 

"'04.08.24 l&) 19 = 22 SA I K^PATENT OFFICE 



@016 

P. 13/17 




®>Inr. Cl. a 
H 04 N 1M0 
G 06 F 15/20 
G. 06 K 9/36 



o n*w¥fWFr op) 

10 1 7136— 5C 

1 0 3 7622— 5 B 

7157— 5B 



<Q> ttl 2> B8 

24168 

©4*83 8§*I57^C1!)82)2 8 9 



m ea5S<iaso)7^i8a 



W «6 * 



*(ti tew* strife w % ^m^ X }x 



-375- 



08/25 /04 15:35 FAX 216 621 6165 RENNER OTTO 20 111 017 

04. 08. ?4 <*) 19:22 SA I K^PATENT OFFICE £ P. 14/17 



* ^ v *jc «j — y * > <t jfc^ ^w*y*v:* 
sic, c wx ti 3 y # V y 3 y*G**?x 

£ co*"**^*** at 3 y # 

Ha^rh <x „ *y cue 010 *o*;*:a^£*K: 

-eco^aen* itijtrfa < nor a ■» it £ ' * 

"C 2& * ■ 

o ti T o^siEf & » 



^/^JRO* fit** -fr"^** «iEl»»« 

8ft u CO**— t <? C L * 1 ) ICS 

^-b^c "(5) 

ti<7^^ <iw*<u > > ^ 3 y*t>^ 

6 C t IC **J * * 

b-pyi l -o<o* y *K l J a— > wf^o 



376— 



08/25/0 4 15:35 FAX 21 6 621 6165 RENNER OTTO 20 Bit 18 

-'04. 08,24 <£) 19:23 SA I £ PATENT OFFICE V P. 15/17 



« 4 ®fz;s;4e&iCJ:<& » v 9 j. — a 
7^ -or* s c * . \ > <v**jEiea9i3 * 3 «g*<u ^ 

tat <*> ^ a * iff .« *c ^ ^ * ^ p * >w « it * ?9 

rx*s^7 h^^^^UBt, 3 * 3 JE«f« 

h « upai £~ 'to/ * 9 *a#<t 

* a» (l -3fl (l JC<e?l<e*Lflfcttl ^4X^*i(G*a> 

.£fCieUTiWiffi0 1 >3>rft»J a — a ^ CD fiiCxOfli 

a , 

£Ui, ac«93 fC-t * ^ 0 -a - f a >«*(fil 
totCVt^Ttt* 1ff%««#IC*s*t 

01 o «t (o c t 9 * ** £ ft *c « «j ee a a * c »t 



\ 



2S7-24168C3) 



^PnO /D*71TP, - P, P3 ie *J * « > 



lft-'/7H";*^ LB ft w^y^y^ 



-377- 



08/25/ 04 15:36 FAX 216 621 6165 RENNER OTTO 20 

' 04. 08: 24 (*) 1 9 : 23 SA I K^ATENT OFF I CE 



El 019 
P. 16/17 



m 3 



»S14S5?~Z416B(4) 



DBS or 



Lg/7> **" SP! " H s * k \ 



"31 




raw 



n 




5 G B 



08/25/04 15:36 FAX 216 621 6165 RENNER OTTO 20 ©020 

'•04. 08:24 (#) 19:23 SAIK^ATENT OFFICE Q P. 17/17 



J4S1EB57-24IB0 (5) 




—379- 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHHJIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



